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Executive Summary 


Why do students in some schools show more progress than others? 


Families, teachers, principals, district leaders, and state and federal 
policymakers have asked this question for decades as they pursue a 
high-quality public K-12 education for all students. For 20 years, the 
5Essentials Survey and its underlying conceptual framework, which 
articulates critical aspects of school climate and organization, have 


helped school communities unpack what may be contributing to—or 
holding back—growth in their students’ outcomes. 


This report updates the original design and validation 
of the 5Essentials Survey, addressing questions about its 


present-day validity and use in schools and districts. 


History and Context: 5Essentials 
Survey and Framework 

The 5£ssentials Survey and underlying framework 
originated in the 1990s as a tool for studying differen- 
tial progress among schools at a time of historic school 
reform in Chicago.’ Researchers at the University of 
Chicago Consortium on School Research (UChicago 
Consortium) examined whether having strength in five 
key areas of school organization explained why some 
schools improved student achievement and others did 
not. In consultation with other researchers, practitio- 
ners, policymakers, and community stakeholders, 
these researchers created a conceptual framework 
called the “Five Essential Supports for School 
Improvement.” This framework identified five key 
elements, or “essential supports,” of a school that 
influenced its students’ learning: Effective Leaders, 


Collaborative Teachers, Involved Families, Supportive 


1 Throughout this report, we refer to the underlying framework 
as the “five essential supports” and the survey that was 
created based on this framework as the 5Essentia/s Survey. 

2 Authors originally used different terms for the five essential 
supports in early reports, referring to: school leadership, pro- 
fessional capacity, parent-community ties, student-centered 
learning climate, and instructional guidance. 


Environment, and Ambitious Instruction.? The 
5Essentials Survey captures the strength of each 
essential support through survey questions (also 
called items) completed by teachers® and students.* 
Underlying concepts that make up each essential, such 
as Instructional Leadership or Student-Teacher Trust, 
are captured using groups of items (called “measures”). 
The 5£Essentials Survey items, measures, and essentials 
are presented in Figure 2 in the full report, replicated 
on page 2. 

A longitudinal validation study using 15 years of 
districtwide elementary school data (collected between 
1991 and 2005) and 20 years of research provided 
evidence that these five essential supports of a school 
organization were the foundation of a school’s ability 
to increase students’ learning gains over time. This 
extensive work was published in the book, Organizing 
Schools for Improvement: Lessons from Chicago in 2010 
and examined the relationship between 5Essentials 
Survey results with elementary school test scores 
and attendance.® A key finding was that students in 


schools that were strong in at least three of the essential 


3 Some but not all of the survey questions completed by 
teachers are also completed by non-teaching staff in 
schools (e.g., teacher assistants, counselors, librarians, etc.). 

4 While a parent survey is given in Chicago Public Schools 
(CPS), this survey is constructed and administered by CPS 
and is not part of the 5Essentia/s Survey. 

5 Bryk, Sebring, Allensworth, Luppescu, & Easton (2010). 
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FIGURE 1 
The Five Essential Supports are Formed by 20 Separate Measures on the 5Essentia/s Survey 
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Note: Measures that comprise the Supportive Environment essential are different for elementary schools (Safety; Student-Teacher Trust; 
Peer Support for Academic Work; Academic Personalism) and high schools (Safety; Student-Teacher Trust; School-Wide Future Orienta- 
tion; Expectations for Post-Secondary Education). Thus, each 5Essentia/s Survey includes 20 measures, but there are 22 unique measures. 


supports were up to 10 times more likely to experience 
substantial gains on both reading and math scores than 
students in schools that were weak in three or more of 


the supports.® 


The current study provides an updated and expanded 
validation of the 5Essentials Survey. This study adds an 
important additional outcome for elementary schools— 
students’ GPAs—and, even more importantly, also 
assesses the validity of the 5Essentials Survey in high 
schools. The high school analyses encompass a range 


of outcomes: test scores, attendance, GPAs, Freshman 


6 Schools were categorized as “strong” on an essential support 
if their survey score on that indicator fell in the top quartile 
of Chicago elementary schools. Schools ranked in the bottom 
quartile for an essential indicator were classified as “weak” on 
that essential support. 

7 The purpose of this study, like other validation studies, is 
to examine the degree to which our measurement tool, the 
5Essentials Survey, does what it is intended to do. In this 


OnTrack rates, and college enrollment. By revalidating 
the 5Essentials Survey and expanding the validation to 
more grade levels and additional student outcomes, this 
study seeks to provide school leaders, teachers, research- 
ers, and other education practitioners with a broad-based 
tool to guide their work building schools in which adults 


and children can learn and thrive.” 


The 5Essentia/s Survey ina 
Changing Education Landscape 
While research shows that the environment students 


and staff experience in schools affects student learning, 


case, we are assessing the extent to which teachers’/staff 
and students’ reports about their school in one year predict 
improvement in outcomes in the subsequent year, and also 
whether growth in 5Essentia/s Survey measures predicts 
improvement in outcomes in the concurrent year. All analy- 
ses controlled for prior student achievement. In the interest 
of transparency, this report aims to clearly articulate our 
findings for public consideration. 
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there are not many school climate tools and measure- 
ments available to educators and policymakers that are 
both validated and useful for identifying challenges in 
schools and guiding their work toward improvement. 
As one of the few validated instruments, the 5Essentials 
Survey is one of the most widely-used tools to measure 
school climate. The 5Essentials Survey has been admin- 
istered in more than 6,000 schools across the country.® 

Nonetheless, the 5Essentials Survey was last vali- 
dated in 2010 and there were some limitations of that 
study. The validation only examined elementary 
schools and three outcomes: reading test scores, math 
test scores, and attendance rates. And the data used for 
the validation are relatively old 1991-2005). 

Since the Organizing for School Improvement valida- 
tion study of the five essential supports, much has 
changed in education both nationally and in Chicago 
Public Schools (CPS). In addition to educational 
practice evolving during this period, accountability 
policies have become an influential part of the context 
of education, both in Chicago and across the country. 
Chicago principals of schools that initially and volun- 
tarily participated in the biennial 5Essentials Survey, 
between 1997 and 2009, were provided a confidential 
report of their results.? The survey evolved to become 
annual and web-based, and later—in 2014—it became 
part of the CPS accountability policy, comprising 5-10 
percent of aschool’s quality rating. Today, in 2020, the 
5Essentials Survey is completed by CPS students in 
grades 4-12 and CPS teachers in grades pre-k-12, and 
reports of results are publicly available.!°" 

Changes like these in the administration and use of 
the survey could potentially strengthen or weaken the 


quality of the data and the degree to which the surveys 


8 Since 2011 many schools and districts have worked with 
UChicago Impact to take the 5Essentia/s Survey and receive 
online reports. The UChicago Consortium and UChicago 
Impact are separate units within the University of Chicago 


Urban Educa-tion Institute CUEI). For more information on UEI, 


please visit https://uei.uchicago.edu/. For more information 
on UChicago Impact’s 5Essentia/s Survey administration, see 
https://www. uchicagoimpact.org/our-offerings/5essentials. 
Of note, the surveys have been available to the public from 
the UChicago Consortium since 1997, and have been the 
foundation of many other school climate instruments, 
including New York City’s Framework for Great Schools; see 
https://www.schools. nyc.gov/about-us/vision-and-mission/ 
framework-for-great-schools for one example. 


accurately represent what is happening in schools. For 
example, increased attention to the importance of the 
5Essentials Survey could improve data quality by rais- 
ing response and completion rates. Better data quality 
would increase the ability to statistically detect and 
measure aconnection between survey outcomes and 
performance, strengthening the validity of the survey 
overall. On the other hand, because school ratings are 
consequential, there could be an incentive or pres- 
sure for schools to appear strong on the five essential 
supports. If respondents exaggerated their school’s 
strengths when responding to the survey, it would com- 
promise the ability of the survey to accurately assess 
schools’ performance, and thereby also compromise the 
relationship between school organization and improve- 
ment in student outcomes. This would be interpreted as 
a lack of validity. 

This study therefore seeks to understand the validity 
of the 5Essentials Survey at the present stage of educa- 
tional practice in both elementary and high schools, and 


under present conditions in CPS. 


Key Findings from First Phase of 
this Study 


Our findings indicate that 5Essentials Survey measures 
continue to be predictive of school improvement in 
elementary schools, and are also predictive in high 
schools. Of the 22 survey measures, all were in some 
way positively and significantly associated with 
schools’ improvement. At the same time, all measures 
were not associated with all outcomes.'? For example, 
yearly attendance rates improved more at elemen- 

tary schools that were strong on 5Essentials Survey 


measures, such as Parent Involvement in School and 


9 Foran example report provided to participating schools from 
1997 to 2009, see https://consortium.uchicago.edu/publica- 
tions/improving-chicagos-schools-millard-fillmore-school 

10 For details about the 5Essentia/s Survey, see https://www. 
5-essentials.org/ 

11 Fourth- and fifth-grade students fully participated in 5Essentia/s 
Surveys for the first time in 2020 and are therefore not included 
in analyses in this study. 

12 Nearly all outcomes were positively related to at least one-half 
the survey measures. The exception is the outcome of college 
enrollment, which was positively and significantly related to 
less than one-half of the measures, when considering measure 
growth instead of measure strength. See p.38 for more details. 
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School Commitment, than at elementary schools that 
had average measure scores.’? The difference be- 
tween yearly growth in attendance rates in schools 
with strong vs. average measure scores was as much 

as an additional 0.48 percentage points in elementary 
school and an additional 3.55 percentage points in high 
school. Similarly, Freshman OnTrack rates improved 
by as much as 3.25 percentage points more in high 
schools with strong 5Essentials Survey measures, such 
as Collective Responsibility and School-Wide Future 
Orientation, compared to schools with average measure 


scores. 4 


Additionally, we found: 

e Both 1) starting out the year with strength in 
5Essentials Survey measures and 2) improving on 
measures during the course of the year predicted 
improved student outcomes in schools. Thus, 
schools that are working to improve in an area, e.g. 
Student-Teacher Trust or Teacher Influence, but 
have not yet reached a point of strength may still see 
improvements in their students’ outcomes such as 
grades, tests, and attendance while they are growing 


their five essential supports. 


e The 5Essentials Survey measures were positively 
and significantly related to growth in elementary 
test scores and attendance. This is consistent with 
the outcomes of our first validation, published in 


Organizing Schools for Improvement in 2010.'° 


e Elementary GPA also improved more in schools 
with strong 5Essentials Survey measures. This is 
a new finding and an important addition since stu- 
dents’ grades are stronger predictors of their success 
in high school than test scores.'® GPA growth was 


not part of the original validation study. 


e High school outcomes—attendance, test scores, 
GPA, Freshman Ontrack, and college enrollment— 


were positively and significantly related to 


13 “Strong” is defined as one standard deviation above the aver- 
age on a particular 5Essentia/s Survey measure in the spring 
prior to the year in which we measure outcome improvement. 

14 For example, a school with strong 5Essentia/s Survey measures 
in the spring of 2016 saw a larger increase in their Freshman 
Ontrack rate (4 percentage points) between the spring 2016 
and spring 2017 than schools that had average 5Essentials 


5Essentials Survey measures. This is the first study 
that has incorporated all of these high school out- 
comes with all 5Essentials Survey measures and 
itis an important contribution to school climate 


research and practice. 


e 5E£Essentials Survey measures predicted improvement 
for schools that were strong compared to other 
schools, but also for schools compared to them- 
selves in stronger vs. weaker years. Our analyses 
looked at both schools compared to other schools, 
and schools compared to themselves over time. This 
finding suggests that the five essential supports do 
not just relate to differences between schools, but 
also to the changes in organizational strength in the 


same schools over time. 


These results suggest that the 5Essentia/s Survey, 
and its underlying framework, continue to be 
meaningful indicators for schools working to 


improve student outcomes. 


Next Steps: Second Phase of 

this Study 

Our next steps will be to examine whether the 5Essentials 
Survey measures relate to outcomes differently across dif- 
ferent school contexts. These contexts include variations 
in student population (e.g., in terms of students’ socioeco- 
nomic status, race/ethnicity, mobility, special education 
status) and also school characteristics, such as those with 
selective enrollment policies, or smaller enrollment. 

And while the quality and robustness of the 5Essentials 
Survey’s statistical underpinnings are critically important 
to the value of this tool, so, too, are the experiences of peo- 
ple who interact with the survey in schools—as respon- 
dents, practitioners, and school leaders. Under-standing 
these experiences and the ways individuals’ perceptions 
shape the dynamics of schools’ engagement with the five 
essential supports represents another priority for this 


research. Thus, in addition to the second-phase technical 


Survey measures. All analyses controlled for prior student 
achievement. Therefore, this is an improvement in the out- 
come greater than that which would have been expected 
based on students’ prior performance. 

15 Bryk et al. (2010). 

16 Allensworth, Gwynne, Moore & de la Torre (2014). 
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validation described above, we are also exploring how CPS positive school outcomes. 
personnel interact with the 5Essentials Survey as a tool in Ultimately, we undertook this two-year study to 
school improvement through interviews with principals ensure a strong research foundation for the 5Essentials 


and teachers in elementary and high schools. This qualita- | Survey and framework as a tool to guide educators, 


tive study is vital to understanding how the 5Essentials policymakers, researchers and families in their work 
Survey influences, and is influenced by, the enactment creating supportive school environments. Findings 

of policies and practices tied to school improvement and from this work will guide ongoing improvements and 
accountability. Furthermore, findings may shed light on additional study of both the five essentials framework 
opportunities for improving communication and report- and 5Essentials Survey. Results from the second phase 


ing of the 5Essentials Survey to more effectively support of this study will be available in early 2021. 
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